Skip to content

Conversation

@denini08
Copy link
Contributor

fixes #501.

On Windows, Path.read_text() uses cp1252 by default, which caused UnicodeDecodeError when reading some dataset files (e.g., in_the_year_2889.txt).

The fix is to explicitly use encoding="utf-8" in read_data_file(), ensuring consistent behavior across platforms. this make the tests run successfully across all operating systems.

Help to help, let me know what you think

@olliestanley olliestanley merged commit 02b7fac into open-thought:main Aug 18, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Tests fail on Windows due to encoding error when reading data files

2 participants